Search for: All records

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to overcome the lack of labeled training samples by learning feature representations from unlabeled data. However, most current SSL techniques in the medical field have been designed for either 2D images or 3D volumes. In practice, this restricts the capability to fully leverage unlabeled data from numerous sources, which may include both 2D and 3D data. Additionally, the use of these pre-trained networks is constrained to downstream tasks with compatible data dimensions.In this paper, we propose a novel framework for unsupervised joint learning on 2D and 3D data modalities. Given a set of 2D images or 2D slices extracted from 3D volumes, we construct an SSL task based on a 2D contrastive clustering problem for distinct classes. The 3D volumes are exploited by computing vectored embedding at each slice and then assembling a holistic feature through deformable self-attention mechanisms in Transformer, allowing incorporating long-range dependencies between slices inside 3D volumes. These holistic features are further utilized to define a novel 3D clustering agreement-based SSL task and masking embedding prediction inspired by pre-trained language models. Experiments on downstream tasks, such as 3D brain segmentation, lung nodule detection, 3D heart structures segmentation, and abnormal chest X-ray detection, demonstrate the effectiveness of our joint 2D and 3D SSL approach. We improve plain 2D Deep-ClusterV2 and SwAV by a significant margin and also surpass various modern 2D and 3D SSL approaches. 

Abstract We present a novel photonic chip design for high bandwidth four-degree optical switches that support high-dimensional switching mechanisms with low insertion loss and low crosstalk in a low power consumption level and a short switching time. Such four-degree photonic chips can be used to build an integrated full-grid Photonic-on-Chip Network (PCN). With four distinct input/output directions, the proposed photonic chips are superior compared to the current bidirectional photonic switches, where a conventionally sizable PCN can only be constructed as a linear chain of bidirectional chips. Our four-directional photonic chips are more flexible and scalable for the design of modern optical switches, enabling the construction of multi-dimensional photonic chip networks that are widely applied for intra-chip communication networks and photonic data centers. More noticeably, our photonic networks can be self-controlling with our proposed Multi-Sample Discovery model, a deep reinforcement learning model based on Proximal Policy Optimization. On a PCN, we can optimize many criteria such as transmission loss, power consumption, and routing time, while preserving performance and scaling up the network with dynamic changes. Experiments on simulated data demonstrate the effectiveness and scalability of the proposed architectural design and optimization algorithm. Perceivable insights make the constructed architecture become the self-controlling photonic-on-chip networks. 

Stent thrombosis (ST) carries a high risk of myocardial infarction and death. Lack of endothelial coverage is an important prognostic indicator of ST after stenting. While stent strut thickness is a critical factor in ST, a mechanistic understanding of its effect is limited and the role of haemodynamics is unclear. Endothelialization was tested using a wound-healing assay and five different stent strut models ranging in height between 50 and 150 µm for circular arc (CA) and rectangular (RT) geometries and a control without struts. Under static conditions, all stent strut surfaces were completely endothelialized. Reversing pulsatile disturbed flow caused full endothelialization, except for the stent strut surfaces of the 100 and 150 µm RT geometries, while fully antegrade pulsatile undisturbed flow with a higher mean wall shear stress caused only the control and the 50 µm CA geometries to be fully endothelialized. Modest streamlining and decrease in height of the stent struts improved endothelial coverage of the peri-strut and stent strut surfaces in a haemodynamics dependent manner. This study highlights the impact of the stent strut height (thickness) and geometry (shape) on the local haemodynamics, modulating reendothelialization after stenting, an important factor in reducing the risk of stent thrombosis. 

Low-resolution analog-to-digital converters (ADCs) have been considered as a practical and promising solution for reducing cost and power consumption in massive Multiple-Input-Multiple-Output (MIMO) systems. Unfortunately, low-resolution ADCs significantly distort the received signals, and thus make data detection much more challenging. In this paper, we develop a new deep neural network (DNN) framework for efficient and low-complexity data detection in low-resolution massive MIMO systems. Based on reformulated maximum likelihood detection problems, we propose two model-driven DNN-based detectors, namely OBMNet and FBMNet, for one-bit and few-bit massive MIMO systems, respectively. The proposed OBMNet and FBMNet detectors have unique and simple structures designed for low-resolution MIMO receivers and thus can be efficiently trained and implemented. Numerical results also show that OBMNet and FBMNet significantly outperform existing detection methods.